Configuring: Timestamp Range Merge

Select two datasets to merge: one a batch definitions dataset, and another with time series data, called the data samples dataset. The batch definitions dataset is used to define the timestamp range, and therefore requires at least two timestamp fields. The data samples dataset has values that are to be merged with fields from the batch definitions dataset, provided the timestamp values fall within the defined batch timestamp range.

Start by highlighting the two datasets to merge, using the control key. Ensure that the datasets selected have timestamps as data types: Date/Time. If not, as would be the case when importing text files, be sure to convert the data types to date/time types using the Transform > Convert types operation.

NOTE: ensure that the format of the timestamp in the dataset is in the same format as the regional settings on your computer. Differences in the position of the day and month values in the timestamp might cause some timestamps to be nonsensical, and the timestamp will thus be shown as a null value, causing errors.

Worked example: Timestamp range merge

Steps to configure

Configure datasets: Select which dataset will be used as the batch definitions dataset, used to define the timestamp range, and which dataset will provide the data sample values. Select the batch start and end timestamp fields to define the timestamp range, and the data samples timestamp field to merge within this range.
Select batch fields: Select the fields from the batch definitions dataset to be included in the merged dataset.
Select data fields: Select the fields from the data samples dataset to be included in the merged dataset.
Execute: A new dataset is created, containing the merged fields from each dataset, that fall within the defined timestamp range. The timestamp range fields are not included; they are simply used to define the timestamp range for merging.

Step 1: Configure datasets

Select which dataset will be used as the batch definitions dataset, used to define the timestamp range, and which dataset will provide the data sample values. Select the batch start and end timestamp fields to define the timestamp range, and the data samples timestamp field to merge within this range.

Batch definitions dataset: requires two or more timestamp fields, of data type Date/Time, used to define the timestamp range.
Data samples dataset: requires one or more timestamp fields, of data type Date/Time, to be merged into the timestamp range.
The drop down menus listing the possible datasets for the batch definitions dataset and data samples dataset contain a maximum of the two datasets highlighted on the recipe palette. Changing the dataset selected for the batch definitions dataset will automatically change the selection of the data samples dataset. The batch definitions dataset and data samples dataset can never be the same dataset.
Choosing the same field for the batch start and batch end timestamp fields results in an invalid selection and you will not be able to proceed to the next page.
If the range start time is greater than the range end time, the two are automatically swapped for a valid timespan.
Only datasets with two or more timestamp fields will be selected for the batch definitions dataset. If there are two datasets with only one timestamp field each, there will be no datasets listed in the batch definitions drop down menu.
Default:
- The first timestamp field from each dataset will be selected.
Minimum configuration:
- Select a batch definitions dataset for the timestamp range, and a dataset for the data sample values.
- Select fields for the batch start and end timestamp fields, from the batch definitions dataset.
- Select the timestamp field for the data samples dataset.
Troubleshooting:
- If there are no fields automatically selected to populate the drop down lists, ensure that the data type for the timestamp fields is Date/Time. To do this, highlight the dataset on the palette > select the Transform > Convert types operation > ensure that the timestamp values are Date/Time data type. If not, convert the data type.

Step 2: Select batch fields

Select the fields from the batch definitions dataset to be included in the merged dataset.

Move fields listed in the [Available] window to the [Selected] window using the [>] and [<] buttons.
Default settings: No fields are selected.
Minimum configuration: At least one field should be selected.

Step 3: Select data fields

Select the fields from the data samples dataset to be included in the merged dataset.

Move fields listed in the [Available] window to the [Selected] window using the [>] and [<] buttons.
Field names that also appear in the first dataset will be incremented with a 01, 02, 03 etc.
Default settings: No fields are selected.
Minimum configuration: At least one field should be selected.

Step 4: Execute

A new dataset will be created, returning only values where the stipulated timestamp from the data samples dataset falls within the timestamp range defined from the batch definitions dataset. Only values of the fields selected during configuration of the operation will be displayed in the merged dataset.

The timestamp range fields are not included; they are simply used to define the timestamp range for merging.